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This study investigated two concepts: (1) whether speeding a human-in-the-loop simulation (or the 
subject’s “world") scales time stress in such a way as to cause primary task performance to reveal workload 
differences between experimental conditions and (2) whether using natural hand motions to control the 
attitude of an aircraft makes controlling the aircraft easier and more intuitive. This was accomplished by 
having pilots and non-pilots make altitude and heading changes using three different control inceptors at 
three simulation speeds. Results indicate that simulation speed does affect workload and controllability. 

The bank and pitch angle error was affected by simulation speed but not by a simulation speed by 
controller type interaction; this may have been due to the relatively easy flying task. Results also indicate 
that pilots could control the bank and pitch angle of an aircraft about equally as well with the glove as with 
the sidestick. Non-pilots approached the pilots’ ability to control the bank and pitch angle of an aircraft 
using the positional glove - where the hand angle is directly proportional to the commanded aircraft angle. 
Therefore, (1) changing the simulation speed lends itself to objectively indexing a subject’s workload and 
may also aid in differentiating among interface concepts based upon performance if the task being studied 
is sufficiently challenging and (2) using natural body movements to mimic the movement of an airplane for 
attitude control is feasible. 


INTRODUCTION 

This study investigated two concepts: (1) whether 
speeding a human-in-the-loop simulation (or the subject’s 
“world”) scales time stress in such a way as to cause primary 
task performance to reveal workload differences between 
experimental conditions and (2) whether using natural hand 
motions to control the attitude of an aircraft makes controlling 
the aircraft easier and more intuitive. 

Speeding up and slowing down the world (or simulation) 
may affect workload. If workload is low, the world can 
accelerate to some speed beyond real time without a 
decrement in performance. If workload is high, as the world 
slows down, performance improves up to a point. Therefore, 
the change in speed from real time to the point at which 
performance changes (either degrades or ceases to improve) 
would indicate the workload level. 

As Pope and Bowles (1982) wrote: 

. . . [T]he time scale of the simulation can be skewed 
so that the entire “world” surrounding the pilot is 
either slowed or speeded relative to real time (and 
pilot reaction time). As the environment departs from 
real time in the slowing direction, an operator 
experiences the same set of tasks as less demanding. 
Conversely, as the virtual world of the simulator is 
quickened beyond real time, the operator experiences 
the same set of tasks as more demanding. 

Using natural hand motions to control aircraft attitude 
would allow for more intuitive control of the aircraft and 
might allow the operators to do control movements in a more 
concurrent manner rather than in a sequential manner. An 
example of this would be turning, descending, and slowing the 
aircraft with one combined hand movement rather than the 
three separate movements that are required using traditional 
cockpit controls. With more intuitive controls, Fitzmaurice, et 
al. (1995) found that people naturally did these functions in 
parallel. In fact, they felt that more traditional interfaces 
hindered operators since they could not move in natural ways 


(Fitzmaurice et al., 1995). But with use comes comfort; non- 
pilots will prefer hand motions while pilots (with a higher 
level of experience) will prefer the stick and rudder method 
(Bartlett, 2000). This concepts also implements the Wings 
idea described by Schutte (1997), which has the operator 
“remain aware of the aircraft through natural interpretation.” 

Related research in controlling aircraft with the body has 
been done at NASA Ames where scientists used muscle nerve 
signals to control an aircraft (Bluck, 2001). When muscle 
nerve signals are used, though, direct feedback and rapid 
response is needed in order to avoid pilot induced oscillations 
(PIO) (Hogan, 1976). Another concern is that continual human 
control like this may fatigue the operator (Milgram, Zhai, & 
Drascic, 1993), which may in turn induce PIO if micro- 
tremors are not filtered out. 

These observations suggested an experimental 
methodology for comparing interface design concepts based 
upon conducting a series of simulator runs with each concept 
at several simulation time scale points corresponding to 
multiples of real time. 

The interface concepts used a glove so that the hand 
changed aircraft bank angle and pitch angle. Using the hand to 
control these inputs was chosen for several reasons. First, 
pilots (and non-pilots) often describe flying through the air 
using their hand. Second, learning to pilot aircraft using a 
joystick or other grasped controller and throttle controls, 
requires acquisition of particular motor-skill coordinations that 
are not intuitive. It is expected that a more intuitive method of 
commanding aircraft flight would reduce the amount of flight 
training time and errors (Schutte, 1997). Third, in high stress 
situations, human controllers tend to revert to more primitive, 
intuitive modes of functioning and abandon acquired skills. 
Lastly, manual flight control typically requires mental 
integration of flight control parameters, such as banking 
requiring a pitch up to maintain altitude. With intuitive hand 
control, flight control functions are intrinsically integrated and 
not artificially separated, reducing the workload demands of 
function coordination. 



Furthermore, performance with a better design concept 
would not be expected to degrade as rapidly as performance 
with an inferior concept as simulation speed is increased. This 
difference in the way task performance responds to changes in 
task time demand or time stress provides a means of 
discriminating the workload imposed by tasks when the 
adaptability of the subject obscures the difference in real time. 

Objective 

The objectives of this study were to determine 
(1) whether increasing the speed of the “world” scales time 
stress in such a way as to cause primary task performance to 
reveal workload differences between experimental conditions 
and (2) whether an operator could control the pitch and bank 
angle of a simulated business jet using hand motions. 

METHOD 


Subjects 

The 12 subjects were NASA Langley employees and 
contractors. Half of the subjects were current certificated 
pilots with at least a Class III medical certificate (Federal 
Aviation Administration, 2006). The rest of the subjects were 
non-pilots. The average age of the pilots was 50 years and the 
average age of the non-pilots was 30 years. The pilots had an 
average of 26 years experience and an average of 8650 hrs of 
flight experience. 

Independent Variables 

Speed of simulation. Each subject had data runs at 3 
simulation speeds: 1 (unity), 1.3, and 2. Unity was defined as 
being real-time and 2 was defined as twice real time. The 
whole simulation speed changed, analogous to hitting the fast 
forward button during play on VCRs. Simulation speed 2 was 
chosen because there was confidence that performance 
differences would be seen at that speed although subjects were 
likely to detect the change in simulation speed. The 1.3 
simulation speed was chosen because a non-detectable change 
in simulation speed by subjects was desired. 

Controller type. Each subject controlled the simulated 
aircraft with hand movements (glove control) during one set of 
experimental runs and with a sidestick during a second, 
identical set of runs. For the glove control, hand movements 
changed the bank and pitch angles of the simulation. 

Bank angle was controlled by the roll variable on the 
glove. A hand roll to the right caused an aircraft bank to the 
right and a hand roll to the left caused an aircraft bank to the 
left. Two types of turning methods were employed but each 
subject saw only one method in order to reduce negative 
transfer effects of glove control methods. With the first 
method, the hand roll angle was proportional to the aircraft 
bank angle (positional) (Equation 1); therefore, the hand must 
maintain a roll angle in order to have the aircraft maintain the 
turn. With the second method, the hand roll angle is pro- 
portional to the rate of turn of the aircraft (rate) (Equation 2); 
therefore, the hand must return to neutral (level) once the 


desired aircraft bank angle is reached otherwise the aircraft 
bank angle will keep increasing. 
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Pitch angle was controlled by the pitch variable on the 
glove. A hand pitch down decreased the aircraft pitch angle 
(pitch down) and a hand pitch up increased the aircraft pitch 
angle (pitch up). As with the bank angle, two types of control 
methods were used. With the first method, the hand pitch 
angle was proportional to the aircraft pitch angle (positional) 
(similar to Equation 1); therefore, the hand must maintain an 
angle in order to maintain the aircraft pitch attitude. With the 
second method, the hand pitch angle was proportional to the 
rate of pitch for the aircraft (rate) (similar to Equation 2); 
therefore, the hand must return to level once the desired 
aircraft pitch attitude is reached otherwise the aircraft pitch 
attitude will keep increasing. 

For sidestick control, sidestick movements changed the 
bank and pitch angles of the simulation. The control methods 
for the sidestick controller were analogous to the methods for 
the glove control, e.g., tilting the sidestick to the right caused 
an aircraft bank to the right. Furthermore, the sidestick 
controller used the rate controller method (similar to Equation 
2), which is typically seen in aircraft. 


Dependent Variables 

The primary dependent variables were the aircraft’s actual 
bank and pitch angle compared to the flight director’s 
indicated bank and pitch angle needed to remain on course. 
These were calculated as root mean square (RMS) errors 
between the aircraft’s actual bank and pitch angle, and the 
flight director’s commanded bank and pitch angle. 

The time taken to answer two situation awareness 
questions was also analyzed. These questions were asked ten 
seconds before and after each maneuver. The time to answer 
these questions was the interval between the time the subjects 
provided an answer and the time when the question was asked. 


Procedure 


When subjects first arrived, they signed a consent form 
before hearing a verbal briefing on the experiment tasks. Sub- 
jects then moved to the simulator where they completed two 
practice runs with the first controller type and its associated 
control method (controller type was counterbalanced across 
subjects - half of the subjects used the sidestick first and then 
the glove where half of those subjects used the positional 
glove and the rest used the rate glove; half of the subjects used 
the glove first where half of those subjects used the positional 
glove and the rest used the rate glove and then the sidestick 
second). After the practice runs, subjects completed 12 data 
runs. During each run, subjects had to accomplish one flight 
level change and one heading change. These maneuvers were 
shown on the map display and on the primary flight display 
(PFD) using the flight director. Ten seconds before a man- 
euver ( i.e ., heading or altitude change) started (“before”), the 



subject answered either a verbal addition or an orientation 
(e.g., What is your current altitude?) question. Ten seconds 
after the maneuver was started (“after”), the subject again 
answered a verbal addition or an orientation question. 

For each run, the simulation speed was either 1, 1.3, or 2; 
subjects were not notified of this variable. The simulation 
speed order was counterbalanced across the sidestick and 
glove (positional and rate) controllers. 

At the end of each run, subjects completed the NASA- 
TLX workload measure questionnaire (Byers, Bittner, & Hill, 
1989; Hart & Staveland, 1988) and a Cooper-Harper (CH) 
controllability scale rating (Cooper & Harper, 1969; Harper & 
Cooper, 1986). 

Finally, subjects completed a similar set of runs with the 
second controller type and its associated control method. 

Apparatus 

The simulations ran on two PCs running Windows™ XP 
Professional. They had a redraw refresh rate of 60Hz and a 
graphics update rate of 30Hz. An out-the-window (OTW) 
view was on a 30-inch LCD screen in the upper middle of the 
layout. The PFD was on the left screen below the OTW 
display and the map display was on the right screen below the 
OTW display. The systems display was to the right of the map 
display. The NASA-TLX and CH questionnaires were to the 
left of the PFD. These four touch screens were 19-inch LCD 
screens with an Elo Touchsystems IntelliTouch overlay for 
touch-screen capability. The sidestick used was a Saitek 
Cyborg evo joystick (Saitek Ltd., 2003). Subjects used their 
left hand to maneuver the sidestick. The glove was a 5DT 
Data Glove 5 (Fifth Dimension Technologies -- 5DT, 2000). 
Subjects used their right hand when using the glove. 

The aircraft simulation was of a Citation X aircraft. The 
aircraft dynamics were modeled in STAGE v9.2 from 
Presagis. VAPS v6.4. 1, also from Presagis, was used for 
generating the displays. 

Data Analysis 

Data was analyzed using SPSS® for Windows vl5. The 
data was analyzed using a 3-way ANOVA and a linear 
regression model with simulation speed, controller type, and 
pilot status (pilot vs. non-pilot) as the independent variables. 

The time to answer the verbal questions was the diff- 
erence in time between when subjects answered the question 
and when the question was asked. The CH ratings were on an 
integer scale. For the NASA-TLX ratings, the six dimensions 
of workload were normalized to a 100-point scale and then 
averaged together. 

RESULTS 

Bank and Pitch Angle RMS Error 

Simulation speed (bank: F {2 , i7)=28.72, p<0.01; pitch: 

F( 2 , n)=9. 17, p<0.01), pilot status (bank: i 7) =173.43, 

p<0.01; pitch: F (li I7) =135.24, p<0.01), controller type (bank: 


Fa, i7) = 24.72, p<0.01; pitch: F^, n)=28.82, p<0.01), and pilot 
status by controller type (bank: /q 2> i 7) =56.73, p<0.01; pitch: 

F {2 I7) =29.15, p<0.01) significantly affected both heading and 
pitch angle RMS errors. In general, the RMS error increased 
linearly with increasing simulation speed. In fact, linear 
regressions for bank and pitch angle RMS errors were sig- 
nificant (p<0.05) (bank angle RMS error = 8.05 * simulation 
speed (R 2 =0.73) and pitch angle RMS error = 1.81 * simu- 
lation speed (R 2 =0.59)) (Figs. 1 and 2). It did not matter much 
which controller pilots used; but non-pilots performed as well 
as pilots when using the glove-positional controller (Fig. 3). 

Although not significant, the controller type by simulation 
speed did show some interesting patterns (Table 1). For both 
the bank and pitch angle RMS error regression on simulation 
speed, the glove-positional controller had the smallest slope. 
Therefore, as simulation speed increases, the glove-positional 
controller performance will degrade the least. 
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Figure 2. Pitch Angle RMS Error by Simulation Speed for 
Each Trial with the Linear Regression Line 
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Figure 3. Pitch and Bank Angle RMS Error by Controller 
Type and Pilot Status 


Table 1. Bank and Pitch Angle RMS Error vs. Simulation 
Speed Regression Line Slopes by Controller Type 


Controller Type 

Bank Angle 
RMS Error 
Slope 

Pitch Angle 
RMS Error 
Slope 

Sidestick 

7.91 

2.01 

Glove-Rate 

10.10 

2.30 

Glove-Positional 

6.37 

0.99 


CH and NASA-TLX Ratings 

In general, the difficulty of the control task was not high. 
The mean CEI rating was 3.5 with a standard error of the mean 
of 0.07. The mean of the workload rating was 38.6 with a 
standard error of the mean of 0.80. Controller type by 
simulation speed (F^, i 7 )=3.51, p<0.01), controller type (CEI: 
F a , n)=8.44, p<0.01; NASA-TLX: F {2 , i 7) =8.85, p<0.01) and 
pilot status by controller type (CEI: F (2 , i 7) =4. 13, p<0.02; 
NASA-TLX: Fa, i 7) =6.64, p<0.01) were significant. All 
controller concepts had equal CEI ratings at the 1.3 simulation 
speed (Fig. 4). At unity, the sidestick had the lowest CH rating 
but at a simulation speed of 2, the sidestick and glove- 
positional had equal CH ratings. Interestingly, pilots rated the 
glove-rate with the highest CH rating and workload (Table 2). 

Time to Answer Situation Awareness Questions 

Addition problem. The maneuver type (heading or altitude 
change) did not affect how long it took subjects to answer the 
addition question but the effect of simulation speed was 
significant (before: Fa, i 7 )=49.16, p<0.01 and after: 

Fa, i 7 )=99.67, p<0.01). Furthermore, a linear regression was 
significant and the equations were the same (add time = 4.52 * 
simulation speed (before: R 2 =0.87 and after: R 2 =0.94)). 

Orientation question. As with the addition problem, 
maneuver type did not affect how long it took subjects to 
answer the orientation question but the effect of simulation 
speed was significant (before: F (1 i 7) =55.36, p<0.01 and after: 
Fa, 171=46.05, p<0.01). Furthermore, a linear regression was 
significant and the equations are essentially the same 
(“before” orientation question time = 5.46 * simulation speed 
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Figure 4. CH Controllability Ratings by Simulation Speed and 
Controller Type 


Table 2. CH Controllability and NASA-TLX Ratings by 
Controller Type and Pilot Status 


Controller 

Type 

CH Rating 

NASA-TLX 

Pilot 

Non-Pilot 

Pilot 

Non-Pilot 

Sidestick 

3.07 

3.36 

38.65 

32.27 

Glove-Rate 

4.75 

4.00 

50.46 

37.03 

Glove- 

Positional 

3.80 

3.72 

34.62 

35.16 


CH: l=best, 10=worst 

NASA-TLX: 0=no workload, 100=high workload 


(R 2 =0.92) and “after” orientation question time = 

5.19 * simulation speed (R 2 =0.46)). 

Final Questionnaire 

Subjects felt that it was easier to control heading 
CF<2,5)=28.61, p <0.01) and altitude (Fa, 5)= 17. 74, p<0.01) with 
the glove. They also felt using the glove was more intuitive 
(Fa, s)=12.68, p<0.01) but a bit more tiring (F(2,5)=3.95, 
p<0.04) although workload of maintaining heading or altitude 
was not significantly different among the controllers (Table 3). 
Also, there was a trend for subjects preferring the positional 
glove a bit more than the sidestick and rate glove although the 
difference was not significant (Fa, s)=3.88, p<0.09). 


Table 3. Means of Subjective Ratings for Ability to Control, 
Intuitiveness, and Invigorating / Tiring 


Controller 

Type 

Mean for 

Control 

Heading 

Control 

Altitude 

Intuitive 

Invigor 
-ating / 
Tiring 

Sidestick 

50 

50 

50 

38 

Glove-Rate 

30 

37 

34 

50 

Glove- 

Positional 

18 

22 

28 

50 


0=hard to control, not intuitive, tiring 
100=easy to control, intuitive, invigorating 
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DISCUSSION 

This study looked at whether speeding a simulation (or 
the “world”) would lend itself to objectively indexing a 
subject’s workload and discriminating between control 
concepts, and whether an operator could control the pitch and 
bank angle of a simulated business jet using hand motions. It 
was expected that using natural hand movements would make 
controlling the aircraft easier and more intuitive. This was 
accomplished by having pilots and non-pilots make altitude 
and heading changes using three different controller 
types/methods each at three different simulation speeds. 

Contrary to expectations, results indicate that changing 
simulation speed does not improve the discriminability of 
reported workload differences. Subjects reported a higher CH 
controllability rating depending on simulation speed and 
controller type but the greatest differentiation of workload 
occurred at the real time point. At higher simulation speeds the 
sidestick and positional glove controllers had equivalent CH 
controllability ratings. However, the time it took subjects to 
reply to questions during each run increased with simulation 
speed. A simple verbal and mental task (addition problem) had 
less effect on the time it took a subject to answer than a verbal 
and searching task (orientation question). The larger increase 
in time to answer for the verbal searching task was expected 
because this task shared visual resources with the main task of 
flight path following. 

The bank and pitch angle RMS errors were affected by 
simulation speed; the error grew as the simulation speed 
increased. Simulation speed by controller type interaction was 
not significant for bank and pitch angle RMS errors. This was 
most likely related to the finding that the flight path following 
task was given a relatively low CH controllability rating. 
However, the slope of both RMS errors across simulation 
speeds was different among the controller types, with the 
glove-positional type degrading the slowest as simulation 
speed increased. This suggests that the glove-positional 
controller type (where the hand angle is directly proportional 
to the commanded aircraft angle) may be the most robust 
under increasing workload. 

Also supporting the benefit of the glove-positional 
controller were the results from the other independent 
variables: pilot status and controller type. Results indicated 
that pilots could control the bank and pitch angle of an aircraft 
about equally as well with the glove as with the sidestick. 
Non-pilots approached the pilots’ ability to control the bank 
and pitch angle of an aircraft using the positional glove. 
Subjects reported that the positional glove was also easier to 
control and more intuitive. Subjects did find the glove 
controller to be more tiring over that of the sidestick. This is 
not surprising in that subjects had to hold their hands up 
during the data runs rather than resting them on a chair arm as 
they did with the sidestick controller. 

Using your hand to control the attitude of an aircraft may 
exemplify the concept of an embodied user interface since the 
control of the object is integrated into the object (Bartlett, 
2000). The majority of the operators find the embodied user 
interface easier to operate (Bartlett, 2000). The results do 
show that non-pilots can approach the performance of pilots 


very quickly on controlling the bank and pitch angle of an 
aircraft using their hands to mimic the movement of the 
airplane. Besides aircraft, this concept could be applied in 
other areas, including UAVs and remote manipulators used in 
space, telesurgery (Bonsor, 2007), the nuclear industry, and 
laboratories. 

Changing simulation speed is an experimental method 
designed to extend the usefulness of primary task performance 
measurement in assessing workload. The universal nature of 
the method is such that human-in-the-loop simulations of 
many types can employ it. The results of the present study 
indicate that the method has the potential to differentiate 
interface concepts based upon performance if the task being 
studied is sufficiently challenging. 
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